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Abstract — The common approach to radial distortion is by 
the means of polynomial approximation, which introduces 
distortion-specific parameters into the camera model and re- 
quires estimation of these distortion parameters. The task 
of estimating radial distortion is to find a radial distortion 
model that allows easy undistortion as well as satisfactory 
accuracy. This paper presents a new class of rational radial 
distortion models with easy analytical undistortion formu- 
lae. Experimental results are presented to show that with 
this class of rational radial distortion models, satisfactory 
and comparable accuracy is achieved. 

Key Words: Camera calibration, Radial distortion, Radial 
undistortion, Polynomial Models, Rational Models. 



I. Introduction 

A. Camera Calibration 

To address the problem of radial distortion, the prob- 
lem of camera calibration needs to be addressed first, 
since the radial distortion is one step in the camera cal- 
ibration procedures. Depending on what kind of calibra- 
tion object used, there are mainly two categories of cal- 
ibration methods: photogrammetric calibration and self- 
calibration. Photogrammetric calibration refers to those 
methods that observe a calibration object whose geome- 
. try in 3-D space is known with a very good precision , 
' PI' Self-calibration does not need any calibration ob- 
ject. It only requires point matches or correspondences 
' from image sequence. In II], it is shown that it is possible 
, to calibrate a camera just by pointing it to the environ- 
' ment, selecting points of interest and then tracking them 
in the image as the camera moves. The obvious advantage 
of the self-calibration method is that it is not necessary 
to know the camera motion and it is easy to set up. The 
disadvantage is that it is usually considered unreliable 0. 
A four step calibration procedure is proposed in |H| where 
the calibration is performed with a known 3-D target. The 
four steps in are: linear parameter estimation, nonlin- 
ear optimization, correction using circle/ellipse, and image 
correction. But for a simple start, linear parameter es- 
timation and nonlinear optimization are enough. In [7], 
a plane-based calibration method is described where the 
calibration is performed by first determining the absolute 
conic B = A~-^A~-'^, where A is a matrix formed by the 
camera's intrinsic parameters. In [JJ, the parameter 7 (a 
parameter describing the skewness of the two image axes) 
is assumed to be zero and it is observed that only the rel- 
ative orientations of planes and camera are of importance 



in avoiding singularities because the planes that are par- 
allel to each other provide exactly the same information. 
The camera calibration method in [5] focuses on the desk- 
top vision system and lies between the photogrammetric 
calibration and the self-calibration, because 2-D metric in- 
formation is used rather than 3-D. The key feature of the 
calibration method in 2 is that the absolute conic B is 
used to estimate the intrinsic parameters and the parame- 
ter 7 can be considered. The proposed technique in P only 
requires the camera to observe a planar pattern at a few 
(at least 3, if both the intrinsic and the extrinsic param- 
eters are to be estimated uniquely) different orientations. 
Either the camera or the calibration object can be moved 
by hand as long as they cause no singularity problem and 
the motion of the calibration object or camera itself needs 
not to be known in advance. 

After estimation of camera parameters, a perspective 
projection matrix M can directly link a point in the 3- 
D world reference frame to its projection (undistorted) in 
the image plane. That is 
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The matrix A fully depends on the 5 intrinsic parameters 
with their detail descriptions in Table where some other 
variables used throughout this paper are also listed. 

The calibration method used in this work first estimates 
the projection matrix and then uses the absolute conic to 
estimate the intrinsic parameters |21 . The detail procedures 
are summarized below: 

• Linear Parameter Estimation, 

— Estimation of Intrinsic Parameters; 

— Estimation of Extrinsic Parameters; 

— Estimation of Distortion Coefficients; 

• Nonlinear Optimization. 

B. Radial Distortion 

Virtually all imaging devices introduce certain amount 
of nonlinear distortion, where the radial distortion is the 



TABLE I 
List of Variables 



Variable 


Description 




3-D point in the world frame 




3-D point in the camera frame 


[R|t] 






Distorted image points in pixel 


(u, v) 


Undistorted image points in pixel 


i^d, Vd) 


[xd,ydAV = J^~'^[ud,Vd,iV' 


{x, y) 


[x,y, 1]'^' = A-'-[u,v, 1]'^' 
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Y ~ ^ 


X" r ,1 
Z<: — f ^ 
Y" J y 
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= X'' + 
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Focal length 




5 intrinsic parameters 


k 


Distortion cocfhcients 


J 


Objective function 


A 


Camera intrinsic matrix 



most severe part jH], |H1- Radial distortion causes an in- 
ward or outward displacement of a given image point from 
its ideal location. The negative radial displacement of the 
image points is referred to as the barrel distortion, while 
the positive radial displacement is referred to as the pin- 
cushion distortion j^. 

The removal or alleviation of radial distortion is com- 
monly performed by first applying a parametric radial dis- 
tortion model, estimating the distortion coefficients, and 
then correcting the distortion. Most of the existing works 
on radial distortion models can be traced back to an early 
study in photogrammetry ID where the radial distortion 
is governed by the following polynomial equation [2], 

m, ini: 

F{r) = r f{r) = r (1 + kir^ + ksr^ + + •••), (2) 
where fci, fe, fcs, . . . are the distortion coefficients and 

El 

r^^x^+y^, (3) 

or [E], [ISI 

r^=Xl + Y^ = f{x'+y^). (4) 

Both of the above two formulae of r are in the camera frame 
and they are basically the same, since the resulting distor- 
tion coefficients have one-to-one relations with each other, 
where one set of distortion coefficients are proportional to 
the other set by a series of scalars (/^, . . .). 

Until recently, the most commonly used radial distortion 
models are still in the polynomial form of (01, though other 
models, such as the division model ^l] and the fish-eye 
radial distortion models (the Fish Eye Transform [2] and 
the Field-Of-View JS]), are available in the literature. 

For the polynomial radial distortion model in |5J| and 
its variations, the distortion is especially dominated by the 
first term and it has also been found that too high an or- 
der may cause numerical instability [2], [H], El- ^^lis 



paper, at most three terms of radial distortion are consid- 
ered. When using two coefficients, the /(r) in ^ becomes 

f{r) = l + kir^ + k2r\ (5) 

The relationship between the distorted and the undistorted 
image points becomes 

Ud~uo = {u-uo){l + kir'^ +k2r'^), 
Vd ^ Vo ^ {v - Vq) (1 + fci + fc2 r'^)- 

The polynomial function in ((JJ has one main drawback, 
that is, the inverse of the polynomial function in |(SJ) is 
difficult to perform analytically but can be obtained nu- 
merically via an iterative scheme. In |16| . for practical 
purpose, only one distortion coefficient fci is used. To over- 
come the inversion problem, another polynomial radial dis- 
tortion model using also two terms is proposed as jl7| 

f{r) = l + kir + k2r^, (7) 

whose main appealing feature lies in its satisfactory ac- 
curacy as well as the existence of an easy analytical radial 
undistortion formula. The two polynomial radial distortion 
models in (0) and (0 act as benchmarks for evaluating the 
performance of the rational distortion models presented in 
Sec. inil 

In this work, a new class of rational radial distortion 
models are proposed. To compare the performance of our 
new models with the existing polynomial approximation 
models, the calibration procedures presented in are ap- 
plied, while being aware that the usage of other calibration 
methods, such as the image registration method in ^S] and 
the plumb-line algorithm in jT^], are also feasible. 

In 0, the estimation of radial distortion is done after 
having estimated the intrinsic and the extrinsic parame- 
ters just before the nonlinear optimization step. So, for 
different radial distortion models, we can reuse the esti- 
mated intrinsic and extrinsic parameters. To compare the 
performance of different radial distortion models, the value 
of optimization function J is used, where the initial guess 
for k is chosen to be 0. The objective function used for 
nonlinear optimization is 

TV n 

J^^^llmy -m(A,fci,/c2,R„t„Mj)f, (8) 

i=l 3 = 1 

where m(A, fci, A:2, Ri, t^, Mj) is the projection of point Mj 
in the i^^ image using the estimated parameters and Mj is 
the j*^ 3-D point in the world frame with Z"^' — 0. Here, n 
is the number of feature points in the coplanar calibration 
object and N is the number of images taken for calibration. 

The rest of the paper is organized as follows. Sec. 
describes the two polynomial radial distortion models lO 
and (0 in detail, where the inverse problem of @ and the 
analytical undistortion formula of iQ are also described. 
The new class of rational radial distortion models and the 
comparison with the existing polynomial models are pre- 
sented in Sec. IIIII Finally, some concluding remarks are 
given in Sec. IIVI 



II. Polynomial Radial Distortion Models and 
Their Undistortion Functions 

From the radial distortion can be resulted in one of 
the following two ways: 

• Transform from the camera frame to the image plane, 
then perform distortion in the image plane 
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• Perform distortion in the camera frame, then transform 
to the image plane 
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This is because 
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Then, © becomes 

Ud = 



Vd = 



{u - uo) f{r) + un 
axf{r) +jyf{r) - 
axd + iyd + uq, 
(v - vq) f{r) + vq 

Pyd + VQ. 



Uo 



(10) 



Ud 




Xd 


Vd 


= A 


Vd 


1 




1 



Therefore, 



Thus, the distortion performed in the image plane can be 
understood from a new point of view: introducing distor- 
tion in the camera frame and then transform to the image 
plane. The radial undistortion can be perfomed by extract- 
ing {x,y) from {xd,yd)- 

A. Radial Undistortion of Model \^ 

The following derivation shows the problem when trying 
to extract {x,y) from {xd,yd) using Q. According to (jS]), 

Xd = xf{r) = x[l + ki{x^ + y2) + k2{x^ + y'^f^ 



yd = yf{r) = y[l + fci(.T2 + 2/2) + fc2(a;2 + 



(11) 



It is obvious that Xd — Q iS. x — Q. When a;^ ^ 0, by letting 
c — yd/xd — y/x, we have y = cx where c is a constant. 
Substituting y = cx into the above equation gives 

Xd=x[l + kl{l+ ^)x^ + fc2(l + c^fx% (12) 

Notice that the above function is an odd function. An 
intuitive understanding of (|12|l is that the radial distortion 
function is to approximate the relationship between Xd and 
a;, which, in ideal cases, is Xd = x. The analytical solution 
of 1)12(1 is not a trivial task, which is still an open problem 
(of course, we can use numerical method to solve it). 



B. Radial Undistortion of Model ^ 

For in a similar manner as for ij^l, we have 



Xd = x[l + fciVT+c? sgn(x)a; -I- k2{l + c^) x'^], (13) 

where sgn(a;) gives the sign of x. To extract x from Xd in 
H13|l . the following algorithm can be applied: 

1) X = iff = 0, 

2) Assuming that x > 0, (fKl|l becomes 



Xd 



= X + fclVl + C^X^ + fc2(l + C^)X^. 



Using solve, a Matlab Symbolic Toolbox function, we can 
get three possible solutions for the above equation denoted 
by Xi+, X2+, and X3+ respectively. To make the equations 

simple, let y = Xd, p = fciVT+c? and q = /c2(l + c^)- The 
three possible solutions for y = x -I- px^ + qx^ are 
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X2+ 
X3+ 

where 

El -- 

E2 -- 



-J-Ei--E2-^ + ^{^Ei~\E2)j, (14) 
V2q 3 Sg 2 6(j 3 

.^E,-lE2-^-^{^E,-lE2)j, 



{36p<j + 108j/q^ - 8p^ 



— 3(7 , 

7 = V^. 



From the above three possible solutions, we discard those 
with imaginary parts not equal to zero. Then, from the 
remaining, discard those solutions that conflict with the 
assumption that x > 0. Finally, we get the candidate solu- 
tion x+ by choosing the one closest to Xd if the number of 
remaining solutions is greater than 1. 
3) Assuming that x < 0, there are also three possible so- 
lutions for 



Xd = X - fci Vl + c2 x^ + ^2(1 + c^)x^, 
which can be written as 



y = X + (— p)x^ + qx^ 



(16) 



(17) 



The three solutions for H17|) can thus be calculated from 
(|14|l and 115|) by substituting p = —p. With a similar 
procedure as described in the case for x > 0, we will have 
another candidate solution x_. 

4) Choose among x+ and x_ for the final solution of x by 
taking the one closest to Xd- 

The basic idea to extract x from Xd in (|13|l is to choose 
from several candidate solutions, whose analytical formulae 
are known. The benefits of using this new radial distortion 
model are as follows: 

• Low order fitting, better for fixed-point implementation; 

• Explicit or analytical inverse function with no numerical 
iterations, which is important for real-time vision applica- 
tions. 



TABLE II 
Distortion Models 



Model # 


fir) 
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X ■ 
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-\- ki 1 -\- X sgn{x) + /i;2 (1 


■f c2)x2) 
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X ■ 
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1 + fcr 
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-\- k \/ 1 -\- c'^ X sgn{x) 

1 
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1 + fcr^ 


X ■ 
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■f /c (1 + c^) 
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1 -|_ fc-^ f. 
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-|- /^^ "v/l -|- C*^ 3^ SQTl(^X^ 




1 + fc2 r2 


X ■ 




1 + A;2 (1 + c2)x2 
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1 


X ■ 




1 




1 + fci r + ^2 '"2 


1 


-f fciVl + x sgn{x] + fe2 (1 4 


c2) x2 


8 


1 + fci r 


X ■ 




1 + fciVl + X sgn{x) 






1 + fc2 »* + fcs f 2 
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-1-^2^1 + xsgn{x) + fca (H 


- c2) x2 
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1 + fci 
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III. Rational Radial Distortion Models 

To be a candidate for radial distortion model, the func- 
tion must satisfy the following properties: 

1) This function is radially symmetric around the image 
center (uq, vq) and it is expressible in terms of radius r 
only; 

2) This function is continuous, hence F{r) — iff r = 0; 

3) The resultant approximation of x^i is an odd function 
of X. 

Based on the above criteria, a new class of radial distortion 
models (model #4,5,6,7,8,9) are proposed and summa- 
rized in Tabled where the other four polynomial models 
(model #0, 1, 2, 3) are also listed. 

Now, we want to compare the performance of our new 
radial distortion models with the four polynomial models in 
Table Inl based on the final value of objective function after 
nonlinear optimization by the Matlab function fminunc. 
Using the public domain test images "SIT, the desktop cam- 
era images (a color camera in our CSOIS), and the ODIS 
camera images ^2] (the camera on ODIS robot built in 
our CSOIS), the final objective function J, the estimated 
distortion coefficients k, and the 5 estimated intrinsic pa- 
rameters (a, /3, 7, ziQ, Wo) are shown in Tables Hill IIVI and 
IVI respectively. The reason for listing {a, /3,j,uo,vq) is 
to show that the estimated parameters after nonlinear op- 
timization are consistent when using different distortion 
models. 

Table Hill IIVI and IVl are of the same format. The first 
column is the model number used in Tabled The second 
column shows the values of objective function J defined 
in The third column, the rank, sorts the distortion 
models by J in a [0-smallest, 9-largest] manner. 

After carefully examining Table IIIII IIVI and we have 
the following observations: 

1) Using the proposed rational models, we can achieve 



comparable, or even better, results compared with the 
polynomial models in Table ^ where the best result is 
from modelo, models or modelg. The advantage of using 
the last two models is that the inverse function is at most 
of order 3. The radial undistortion can thus be performed 
using the procedures described in Sec. III-BI 

2) For each category of models, either polynomial or ratio- 
nal, they generally follow the trend that the more complex 
the model, the more accurate the performance (the smaller 
the objective function J); 

3) There is no general rule to decide at which point the 
polynomial models become better than the rational ones. It 
is dependent on the particular data set. However, the last 
three rational models always give the best results among 
all the non-iterative models, model 1-9; 

4) When the distortion is significant, the performance im- 
provement using complex models is more obvious. 

To make the results in this paper repeatable 
by other researchers for further investigation, we 
present the options we use for the nonlinear op- 
timization: options = optimset ( 'Display' , 'iter', 
' LargeScale ' , ' of f ' , ' MaxFunEvals ' , 8000 , ' TolX ' , 
10"^ 'TolFun', 10"^, 'Maxlter', 120). The raw 
data of the extracted feature locations in the image plane 
are also available upon request. 

IV. Concluding Remarks 

This paper proposes a new class of rational radial distor- 
tion models. The appealing part of these distortion models 
is that they preserve high accuracy together with easy an- 
alytical undistortion formulae. Performance comparisons 
are made between this class of new rational models and 
the existing polynomial models. Experiments results are 
presented to show that this new class of rational distortion 
models can be quite accurate and efficient especially when 



TABLE III 

Comparison Results using Microsoft Images 



# 


J 


Rank 


Final Values of k 




Final Values of (n: 


1- «()■ I'a) 







lli.8S02 


2 


-0.228() 


0.1905 




«:-!2. i8(i() 


0.2012 


:-!0:-!.9()0r) 


832.5157 


20().5811 


1 


180.5714 


8 


-0.0984 


845.3051 


0.1918 


303.5723 


845.2628 


208.4394 


2 


148.2789 


7 


-0.1984 






830.7425 


0.2166 


303.9486 


830.7983 


206.5574 


3 


145.6592 


5 


-0.0215 


-0.1566 




833.6508 


0.2075 


303.9847 


833.6866 


206.5553 


4 


185.0628 


9 


0.1031 


846.1300 


0.1921 


303.5070 


846.0823 


208.6944 


5 


147.0000 


6 


0.2050 


831.0863 


0.2139 


303.9647 


831.1368 


206.5175 


6 


145.4682 


4 


-0.0174 


0.1702 




833.3970 


0.2071 


303.9689 


833.4324 


206.5567 


7 


145.4504 


3 


0.0170 


0.1725 




833.3849 


0.2068 


303.9719 


833.4198 


206.5443 


8 


144.8328 


1 


1.6457 


1.6115 


0.4054 


830.9411 


0.2044 


303.9571 


830.9705 


206.5833 


9 


144.8257 





1.2790 


-0.0119 


1.5478 


831.7373 


0.2045 


303.9573 


831.7665 


206.5925 



TABLE IV 

Comparison Results using Desktop Images 



# 


J (x lO'^) 


Rank 


Final Values of k 




Final Values of (a 


7, iio,/3, fo) 







0.7790 





-0.3435 


0.1232 




277.1449 


-0.5731 


153.0882 


270.5582 


119.8105 


1 


1.0107 


8 


-0.2100 


295.5731 


-0.819(i 


150.0108 


288.871)3 


119.8528 


2 


0.9047 


7 


-0.2765 






275.5953 


-0.6665 


158.2016 


269.2301 


121.5257 


3 


0.8033 


6 


-0.1067 


-0.1577 




282.5642 


-0.6199 


154.4913 


275.9019 


120.0924 


4 


1.2018 


9 


0.3045 


302.2339 


-1.0236 


160.5601 


295.6767 


120.7448 


5 


0.7986 


5 


0.3252 


276.2521 


-0.5780 


154.7976 


269.7064 


120.3235 


6 


0.7876 


4 


-0.0485 


0.2644 




279.5062 


-0.5888 


154.1735 


272.8822 


119.9564 


7 


0.7864 


3 


0.0424 


0.2834 




279.3268 


-0.5870 


154.1168 


272.7049 


119.9214 


8 


0.7809 


2 


0.5868 


0.5271 


0.5302 


275.8311 


-0.5735 


153.9991 


269.2828 


119.8195 


9 


0.7800 


1 


0.2768 


-0.0252 


0.6778 


276.4501 


-0.5731 


153.9914 


269.8850 


119.8091 



TABLE V 

Comparison Results using ODIS Images 



# 


J (x 10^) 


Rank 


Final Values of k 




Final Values of (a 


7, uo,/3, fo) 







0.8403 


2 


-0.3554 


0.1633 




260.7658 


-0.2741 


140.0581 


255.1489 


113.1727 


1 


0.9444 


8 


-0.2327 


274.2660 


-0.1153 


140.3620 


268.3070 


114.3916 


2 


0.9331 


7 


-0.2752 


258.3193 


-0.5165 


137.2150 


252.6856 


115.9302 


3 


0.8513 


5 


-0.1192 


-0.1365 




266.0850 


-0.3677 


139.9198 


260.3133 


113.2412 


4 


1.0366 


9 


0.2828 


278.0218 


-0.0289 


139.5948 


271.9274 


116.2992 


5 


0.8676 


6 


0.3190 


259.4947 


-0.4301 


139.1252 


253.8698 


113.9611 


6 


0.8450 


4 


-0.0815 


0.2119 




264.4038 


-0.3505 


140.0528 


258.6809 


113.1445 


7 


0.8438 


3 


0.0725 


0.2419 




264.1341 


-0.3429 


140.1092 


258.4206 


113.1129 


8 


0.8379 





1.2859 


1.1839 


0.7187 


259.2880 


-0.2824 


140.2936 


253.7043 


113.0078 


9 


0.8383 


1 


0.4494 


-0.0124 


0.8540 


260.9370 


-0.2804 


140.2437 


255.3178 


113.0561 



the actual distortion is significant. 
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